Goto

Collaborating Authors

 Karachi



Rethinking Test-Time Training: Tilting The Latent Distribution For Few-Shot Source-Free Adaptation

arXiv.org Machine Learning

Often, constraints arise in deployment settings where even lightweight parameter updates e.g. parameter-efficient fine-tuning could induce model shift or tuning instability. We study test-time adaptation of foundation models for few-shot classification under a completely frozen-model regime, where additionally, no upstream data are accessible. We propose arguably the first training-free inference method that adapts predictions to the new task by performing a change of measure over the latent embedding distribution induced by the encoder. Using task-similarity scores derived from a small labeled support set, exponential tilting reweights latent distributions in a KL-optimal manner without modifying model parameters. Empirically, the method consistently competes with parameter-update-based methods across multiple benchmarks and shot regimes, while operating under strictly and universally stronger constraints. These results demonstrate the viability of inference-level distributional correction for test-time adaptation even with a fully-frozen model pipeline.


Blind Ultrasound Image Enhancement via Self-Supervised Physics-Guided Degradation Modeling

arXiv.org Machine Learning

Ultrasound (US) interpretation is hampered by multiplicative speckle, acquisition blur from the point-spread function (PSF), and scanner- and operator-dependent artifacts. Supervised enhancement methods assume access to clean targets or known degradations; conditions rarely met in practice. We present a blind, self-supervised enhancement framework that jointly deconvolves and denoises B-mode images using a Swin Convolutional U-Net trained with a \emph{physics-guided} degradation model. From each training frame, we extract rotated/cropped patches and synthesize inputs by (i) convolving with a Gaussian PSF surrogate and (ii) injecting noise via either spatial additive Gaussian noise or complex Fourier-domain perturbations that emulate phase/magnitude distortions. For US scans, clean-like targets are obtained via non-local low-rank (NLLR) denoising, removing the need for ground truth; for natural images, the originals serve as targets. Trained and validated on UDIAT~B, JNU-IFM, and XPIE Set-P, and evaluated additionally on a 700-image PSFHS test set, the method achieves the highest PSNR/SSIM across Gaussian and speckle noise levels, with margins that widen under stronger corruption. Relative to MSANN, Restormer, and DnCNN, it typically preserves an extra $\sim$1--4\,dB PSNR and 0.05--0.15 SSIM in heavy Gaussian noise, and $\sim$2--5\,dB PSNR and 0.05--0.20 SSIM under severe speckle. Controlled PSF studies show reduced FWHM and higher peak gradients, evidence of resolution recovery without edge erosion. Used as a plug-and-play preprocessor, it consistently boosts Dice for fetal head and pubic symphysis segmentation. Overall, the approach offers a practical, assumption-light path to robust US enhancement that generalizes across datasets, scanners, and degradation types.


Technical note on Sequential Test-Time Adaptation via Martingale-Driven Fisher Prompting

arXiv.org Machine Learning

We present a theoretical framework for M-FISHER, a method for sequential distribution shift detection and stable adaptation in streaming data. For detection, we construct an exponential martingale from non-conformity scores and apply Ville's inequality to obtain time-uniform guarantees on false alarm control, ensuring statistical validity at any stopping time. Under sustained shifts, we further bound the expected detection delay as $\mathcal{O}(\log(1/ฮด)/ฮ“)$, where $ฮ“$ reflects the post-shift information gain, thereby linking detection efficiency to distributional divergence. For adaptation, we show that Fisher-preconditioned updates of prompt parameters implement natural gradient descent on the distributional manifold, yielding locally optimal updates that minimize KL divergence while preserving stability and parameterization invariance. Together, these results establish M-FISHER as a principled approach for robust, anytime-valid detection and geometrically stable adaptation in sequential decision-making under covariate shift.


Technical note on Fisher Information for Robust Federated Cross-Validation

arXiv.org Machine Learning

When training data are fragmented across batches or federated-learned across different geographic locations, trained models manifest performance degradation. That degradation partly owes to covariate shift induced by data having been fragmented across time and space and producing dissimilar empirical training distributions. Each fragment's distribution is slightly different to a hypothetical unfragmented training distribution of covariates, and to the single validation distribution. To address this problem, we propose Fisher Information for Robust fEderated validation (\textbf{FIRE}). This method accumulates fragmentation-induced covariate shift divergences from the global training distribution via an approximate Fisher information. That term, which we prove to be a more computationally-tractable estimate, is then used as a per-fragment loss penalty, enabling scalable distribution alignment. FIRE outperforms importance weighting benchmarks by $5.1\%$ at maximum and federated learning (FL) benchmarks by up to $5.3\%$ on shifted validation sets.


Adapting to Fragmented and Evolving Data: A Fisher Information Perspective

arXiv.org Machine Learning

Modern machine learning systems operating in dynamic environments often face \textit{sequential covariate shift} (SCS), where input distributions evolve over time while the conditional distribution remains stable. We introduce FADE (Fisher-based Adaptation to Dynamic Environments), a lightweight and theoretically grounded framework for robust learning under SCS. FADE employs a shift-aware regularization mechanism anchored in Fisher information geometry, guiding adaptation by modulating parameter updates based on sensitivity and stability. To detect significant distribution changes, we propose a Cramer-Rao-informed shift signal that integrates KL divergence with temporal Fisher dynamics. Unlike prior methods requiring task boundaries, target supervision, or experience replay, FADE operates online with fixed memory and no access to target labels. Evaluated on seven benchmarks spanning vision, language, and tabular data, FADE achieves up to 19\% higher accuracy under severe shifts, outperforming methods such as TENT and DIW. FADE also generalizes naturally to federated learning by treating heterogeneous clients as temporally fragmented environments, enabling scalable and stable adaptation in decentralized settings. Theoretical analysis guarantees bounded regret and parameter consistency, while empirical results demonstrate FADE's robustness across modalities and shift intensities.


'Slippery slope': How will Pakistan strike India as tensions soar?

Al Jazeera

Islamabad, Pakistan โ€“ On Wednesday evening, as Pakistan grappled with the aftermath of a wave of missile strikes from India that hit at least six cities, killing 31 people, the country's military spokesperson took to a microphone with a chilling warning. "When Pakistan strikes India, it will come at a time and place of its own choosing," Lieutenant General Ahmed Sharif Chaudhry said in a media briefing. "The whole world will come to know, and its reverberation will be heard everywhere." Two days later, India and Pakistan have moved even closer to the brink of war. On Thursday, May 8, Pakistan accused India of flooding its airspace with kamikaze drones that were brought down over major cities, including Lahore and Karachi.


India and Pakistan: The first drone war between nuclear-armed neighbours

BBC News

The world's first drone war between nuclear-armed neighbours has erupted in South Asia. On Thursday, India accused Pakistan of launching waves of drones and missiles at three military bases in Indian territory and Indian-administered Kashmir - an allegation Islamabad swiftly denied. Pakistan claimed it had shot down 25 Indian drones in recent hours. Experts say the tit-for-tat attacks mark a dangerous new phase in the decades-old rivalry, as both sides exchange not just artillery but unmanned weapons across a volatile border. As Washington and other global powers urge restraint, the region is teetering on the edge of escalation, with drones - silent, remote and deniable - opening a new chapter in the India-Pakistan conflict.


India-Pakistan drone war heats up

Al Jazeera

Pakistan's military says it brought down 25 Indian drones over cities including Karachi and Lahore. India says Pakistan had targeted India and Indian-administered Kashmir with drones and missiles that were shot down. The exchanges are fueling fears of a new phase in the ongoing tensions between the nuclear-armed neighbours.


Have India and Pakistan started a drone war?

Al Jazeera

Pakistan's military said on Thursday morning that the country's air defence system had brought down 25 Indian drones overnight over some of the country's chief cities, including Lahore and Karachi. At least one civilian has died, and five people were wounded, it said. India's Defence Ministry confirmed hours later that it had targeted Pakistan's air defence radars and claimed that it was able to "neutralize" one defence system in Lahore. It said Pakistan had attempted to attack India and Indian-administered Kashmir with drones and missiles overnight, but that these had been shot down. The drone attacks represent the latest escalation between the nuclear-armed neighbours, a day after India launched deadly missile strikes on Pakistan and Pakistan-administered Kashmir, killing at least 31 people, according to Islamabad.